Ensemble Of Networks Research Articles

Artificial Intelligence in enhancing sustainable practices for infectious municipal waste classification

This research paper focuses on effective infectious municipal waste management in urban settings, highlighting a dearth of dedicated research in this domain. Unlike general or specific waste types, infectious waste poses distinct health and environmental risks. Leveraging advanced artificial intelligence techniques, we prioritize infectious waste categorization and optimization, integrating metaheuristics into optimization methods to create a robust dual-ensemble framework. Our model, the “Enhanced Artificial Intelligence for Infectious Municipal Waste Classification System,” combines ensemble image segmentation methods and diverse convolutional neural network models. Innovative geometric image augmentation enhances model robustness, diversifies training data, and improves accuracy across waste types. A pivotal aspect is the integration of a reinforcement learning-differential evolution algorithm as a decision fusion strategy, optimizing classification by harmonizing outputs from ensemble methods and convolutional neural network models. Computational results, using a newly collected dataset, demonstrate our model’s accuracy exceeding 96.54% while using the existing solid waste dataset we achieve the accuracy of 97.81%, outperforming advanced approaches by margins ranging from 2.02% to 8.80%. This research significantly advances sustainable waste management, showcasing artificial intelligence’s transformative potential in addressing intricate waste challenges. It establishes a foundational framework prioritizing efficiency, effectiveness, and sustainability for future waste management solutions. Acknowledging the importance of diverse datasets, customization for urban contexts, and practical integration into existing infrastructures, our work contributes to the broader discourse on the role of artificial intelligence in evolving waste management practices.

When Two Eyes Don’t Suffice—Learning Difficult Hyperfluorescence Segmentations in Retinal Fundus Autofluorescence Images via Ensemble Learning

Hyperfluorescence (HF) and reduced autofluorescence (RA) are important biomarkers in fundus autofluorescence images (FAF) for the assessment of health of the retinal pigment epithelium (RPE), an important indicator of disease progression in geographic atrophy (GA) or central serous chorioretinopathy (CSCR). Autofluorescence images have been annotated by human raters, but distinguishing biomarkers (whether signals are increased or decreased) from the normal background proves challenging, with borders being particularly open to interpretation. Consequently, significant variations emerge among different graders, and even within the same grader during repeated annotations. Tests on in-house FAF data show that even highly skilled medical experts, despite previously discussing and settling on precise annotation guidelines, reach a pair-wise agreement measured in a Dice score of no more than 63–80% for HF segmentations and only 14–52% for RA. The data further show that the agreement of our primary annotation expert with herself is a 72% Dice score for HF and 51% for RA. Given these numbers, the task of automated HF and RA segmentation cannot simply be refined to the improvement in a segmentation score. Instead, we propose the use of a segmentation ensemble. Learning from images with a single annotation, the ensemble reaches expert-like performance with an agreement of a 64–81% Dice score for HF and 21–41% for RA with all our experts. In addition, utilizing the mean predictions of the ensemble networks and their variance, we devise ternary segmentations where FAF image areas are labeled either as confident background, confident HF, or potential HF, ensuring that predictions are reliable where they are confident (97% Precision), while detecting all instances of HF (99% Recall) annotated by all experts.

Distinguishing the Uterine Artery, the Ureter, and Nerves in Laparoscopic Surgical Images Using Ensembles of Binary Semantic Segmentation Networks.

Performing a minimally invasive surgery comes with a significant advantage regarding rehabilitating the patient after the operation. But it also causes difficulties, mainly for the surgeon or expert who performs the surgical intervention, since only visual information is available and they cannot use their tactile senses during keyhole surgeries. This is the case with laparoscopic hysterectomy since some organs are also difficult to distinguish based on visual information, making laparoscope-based hysterectomy challenging. In this paper, we propose a solution based on semantic segmentation, which can create pixel-accurate predictions of surgical images and differentiate the uterine arteries, ureters, and nerves. We trained three binary semantic segmentation models based on the U-Net architecture with the EfficientNet-b3 encoder; then, we developed two ensemble techniques that enhanced the segmentation performance. Our pixel-wise ensemble examines the segmentation map of the binary networks on the lowest level of pixels. The other algorithm developed is a region-based ensemble technique that takes this examination to a higher level and makes the ensemble based on every connected component detected by the binary segmentation networks. We also introduced and trained a classic multi-class semantic segmentation model as a reference and compared it to the ensemble-based approaches. We used 586 manually annotated images from 38 surgical videos for this research and published this dataset.

Cloud detection from multi-angular polarimetric satellite measurements using a neural network ensemble approach

Abstract. This paper describes a neural network cloud masking scheme from PARASOL (Polarization and Anisotropy of Reflectances for Atmospheric Science coupled with Observations from a Lidar) multi-angle polarimetric measurements. The algorithm has been trained on synthetic measurements and has been applied to the processing of 1 year of PARASOL data. Comparisons of the retrieved cloud fraction with MODIS (Moderate Resolution Imaging Spectroradiometer) products show overall agreement in spatial and temporal patterns, but the PARASOL neural network (PARASOL-NN) retrieves lower cloud fractions. Comparisons with a goodness-of-fit mask from aerosol retrievals suggest that the NN cloud mask flags fewer clear pixels as cloudy than MODIS (∼ 3 % of the clear pixels versus ∼ 15 % by MODIS). On the other hand the NN classifies more pixels incorrectly as clear than MODIS (∼ 20 % by NN, versus ∼ 15 % by MODIS). Additionally, the NN and MODIS cloud mask have been applied to the aerosol retrievals from PARASOL using the Remote Sensing of Trace Gas and Aerosol Products (RemoTAP) algorithm. Validation with AERONET shows that the NN cloud mask performs comparably with MODIS in screening residual cloud contamination in retrieved aerosol properties. Our study demonstrates that cloud masking from multi-angle polarimeter (MAP) aerosol retrievals can be performed based on the MAP measurements themselves, making the retrievals independent of the availability of a cloud imager.

Crack pattern–based machine learning prediction of residual drift capacity in damaged masonry walls

AbstractIn this paper, we present a method based on an ensemble of convolutional neural networks (CNNs) for the prediction of residual drift capacity in unreinforced damaged masonry walls using as only input the crack pattern. We use an accurate block‐based numerical model to generate mechanically consistent crack patterns induced by external actions (earthquake‐like loads and differential settlements). For a damaged masonry wall, we extract the crack width cumulative distribution, we derive a crack width exceedance curve (CWEC), and we evaluate the drift loss (DL) with respect to the undamaged wall. Numerous pairs of CWEC and DL are thus generated and used for training (and validating) an ensemble of CNNs generated via repeated ‐folding cross validation with shuffling. As a result, a method for damage prognosis (Level IV of SHM) is provided. Such method appears general, inexpensive, and able to adequately predict the DL using as only input the CWEC, providing real‐time support for decision making in damaged masonry structures.

Dynamically selected steady states and criticality in non-reciprocal networks

We consider a simple neural network model, evolving via non-linear coupled stochastic differential equations, where neural couplings are random Gaussian variables with non-zero mean and arbitrary degree of reciprocity. Using a path-integral approach, we analyse the dynamics, averaged over the network ensemble, in the thermodynamic limit. Our results show that for any degree of reciprocity in the couplings, two types of criticality emerge, corresponding to ferromagnetic and spin-glass order, respectively. The critical lines separating the disordered from the ordered phases is consistent with spectral properties of the coupling matrix, as derived from random matrix theory. As the non-reciprocity (or asymmetry) in the couplings increases, both ordered phases diminish in size, ultimately resulting in the disappearance of the spin-glass phase when the couplings become anti-symmetric. We investigate non-fixed point steady-state solutions for uncorrelated interactions. For such solutions the time-lagged correlation function evolves according to a gradient-descent dynamics on a potential, which depends on the stationary variance. Our analysis shows that in the spin-glass region, the variance dynamically selected by the system leads the correlation function to evolve on the separatrix curve, limiting different realizable steady states, whereas in the ferromagnetic region, a fixed point solution is selected as the only realizable steady state. In the spin-glass region, stationary solutions are unstable against perturbations that break time-translation invariance, indicating chaotic behaviour in large single network instances. Numerical analysis of Lyapunov exponents confirms that chaotic behaviour emerges throughout the spin-glass region, for any value of the coupling correlations. While negative correlations increase the strength of chaos, positive ones reduce it, with chaos disappearing for reciprocal (i.e. symmetric) couplings, where marginal stability is attained. On the other hand, in finite size non-reciprocal networks, fixed points and limit cycles can arise in the spin-glass region, especially close to the critical line. Finally, we show that chaos is suppressed when the strength of external noise exceeds a certain threshold. Intriguing analogies between chaotic phases in non-equilibrium systems and spin-glass phases in equilibrium are put forward.

Cluster-based wireless sensor network framework for denial-of-service attack detection based on variable selection ensemble machine learning algorithms

A Cluster-Based Wireless Sensor Network (CBWSN) is a system designed to remotely control and monitor specific events or phenomena in areas such as smart grids, intelligent healthcare, circular economies in smart cities, and underwater surveillance. The wide range of applications of technology in almost every field of human activity exposes it to various security threats from cybercriminals. One of the pressing concerns that requires immediate attention is the risk of security breaches, such as intrusions in wireless sensor network traffic. Poor detection of denial-of-service (DoS) attacks, such as Grayhole, Blackhole, Flooding, and Scheduling attacks, can deplete the energy of sensor nodes. This can cause certain sensor nodes to fail, leading to a degradation in network coverage or lifetime. The detection of such attacks has resulted in significant computational complexity in the related works. As new threats arise, security attacks get more sophisticated, focusing on the target system's vulnerabilities. This paper proposed the development of Cluster-Based Wireless Sensor Network and Variable Selection Ensemble Machine Learning Algorithms (CBWSN_VSEMLA) as a security threats detection system framework for DoS attack detection. The CBWSN model is designed using a Fuzzy C-Means (FCM) clustering technique, whereas VSEMLA is a detection system comprised of Principal Component Analysis (PCA) for feature selection and various ensemble machine learning algorithms (Bagging, LogitBoost, and RandomForest) for the detection of grayhole attacks, blackhole attacks, flooding attacks, and scheduling attacks. The experimental results of the model performance and complexity comparison for DoS attack evaluation using the WSN-DS dataset show that the PCA_RandomForest IDS model outperforms with 99.999 % accuracy, followed by the PCA_Bagging IDS model with 99.78 % accuracy and the PCA_LogitBoost model with 98.88 % accuracy. However, the PCA_RandomForest model has a high computational complexity, taking 231.64 s to train, followed by the PCA_LogitBoost model, which takes 57.44 s to train, and the PCA_Bagging model, which takes 0.91 s to train to be the best in terms of model computational complexity. Thus, the models surpassed all baseline models in terms of model detection accuracy on flooding, scheduling, grayhole, and blackhole attacks.

Ensemble learning and ground-truth validation of synaptic connectivity inferred from spike trains.

Probing the architecture of neuronal circuits and the principles that underlie their functional organization remains an important challenge of modern neurosciences. This holds true, in particular, for the inference of neuronal connectivity from large-scale extracellular recordings. Despite the popularity of this approach and a number of elaborate methods to reconstruct networks, the degree to which synaptic connections can be reconstructed from spike-train recordings alone remains controversial. Here, we provide a framework to probe and compare connectivity inference algorithms, using a combination of synthetic ground-truth and in vitro data sets, where the connectivity labels were obtained from simultaneous high-density microelectrode array (HD-MEA) and patch-clamp recordings. We find that reconstruction performance critically depends on the regularity of the recorded spontaneous activity, i.e., their dynamical regime, the type of connectivity, and the amount of available spike-train data. We therefore introduce an ensemble artificial neural network (eANN) to improve connectivity inference. We train the eANN on the validated outputs of six established inference algorithms and show how it improves network reconstruction accuracy and robustness. Overall, the eANN demonstrated strong performance across different dynamical regimes, worked well on smaller datasets, and improved the detection of synaptic connectivity, especially inhibitory connections. Results indicated that the eANN also improved the topological characterization of neuronal networks. The presented methodology contributes to advancing the performance of inference algorithms and facilitates our understanding of how neuronal activity relates to synaptic connectivity.

FPGA-based fast bin-ratio spiking ensemble network for radioisotope identification

In this work, we demonstrate the training, conversion, and implementation flow of an FPGA-based bin-ratio ensemble spiking neural network applied for radioisotope identification. The combination of techniques including learned step quantisation (LSQ) and pruning facilitated the implementation by compressing the network’s parameters down to 30% yet retaining the accuracy of 97.04% with an accuracy loss of less than 1%. Meanwhile, the proposed ensemble network of 20 3-layer spiking neural networks (SNNs), which incorporates 1160 spiking neurons, only needs 334 μs for a single inference with the given clock frequency of 100 MHz. Under such optimisation, this FPGA implementation in an Artix-7 board consumes 157 μJ per inference by estimation.

Reconnaissance of Allostery via the Restoration of Native p53 DNA-Binding Domain Dynamics in Y220C Mutant p53 Tumor Suppressor Protein.

Allosteric regulation of protein dynamics infers a long-range deliberate propagation of information via micro- and macroscale interactions. The Y220C structural mutant is one of the most frequent cancerous p53 mutants. The mutation is distally located from the DNA-binding site of the p53 DNA-binding domain yet causes changes in DNA recognition. This system presents a unique opportunity to examine the allosteric control of mutated proteins under a drug design paradigm. We focus on the key case study of p53 Y220C mutation restoration by a series of new compounds suggested to have Y220C reactivation properties in comparison to our previous findings on the restorative potential of PK11000, a compound studied extensively for reactivation in vitro and in vivo. Previously, we implemented all-atom molecular dynamics (MD) simulations and our lab's techniques of MD-Sectors and MD-Markov state models on the wild type, the Y220C mutant, and Y220C with PK11000 to characterize the effector's restorative properties in terms of conformational dynamics and hydrogen bonding. In this study, we turn to probing the effects made by docking the battery of a new but less well-tested set of aminobenzothiazole derivative compounds reported by Baud et al., which show promise of Y220C rescue. We find that while complete and precise reconstitution of p53 WT molecular dynamics may not be observed as was the case with PK11000, dispersed local reconstitution of loop dynamics provides evidence of rescuing effects by aminobenzothiazole derivative N,2-dihydroxy-3,5-diiodo-4-(1H-pyrrol-1-yl)benzamide, Effector 22, like what we observed for PK11000. Generalizable insights into the mutation and allosteric reactivation of p53 by various effectors by reconstitution of WT dynamics observed in statistical conformational ensemble analysis and network inference are discussed, considering the development of allosteric drug design rooted in first principles.

Plant disease recognition using residual convolutional enlightened Swin transformer networks

Agriculture plays a pivotal role in the economic development of a nation, but, growth of agriculture is affected badly by the many factors one such is plant diseases. Early stage prediction of these disease is crucial role for global health and even for game changers the farmer’s life. Recently, adoption of modern technologies, such as the Internet of Things (IoT) and deep learning concepts has given the brighter light of inventing the intelligent machines to predict the plant diseases before it is deep-rooted in the farmlands. But, precise prediction of plant diseases is a complex job due to the presence of noise, changes in the intensities, similar resemblance between healthy and diseased plants and finally dimension of plant leaves. To tackle this problem, high-accurate and intelligently tuned deep learning algorithms are mandatorily needed. In this research article, novel ensemble of Swin transformers and residual convolutional networks are proposed. Swin transformers (ST) are hierarchical structures with linearly scalable computing complexity that offer performance and flexibility at various scales. In order to extract the best deep key-point features, the Swin transformers and residual networks has been combined, followed by Feed forward networks for better prediction. Extended experimentation is conducted using Plant Village Kaggle datasets, and performance metrics, including accuracy, precision, recall, specificity, and F1-rating, are evaluated and analysed. Existing structure along with FCN-8s, CED-Net, SegNet, DeepLabv3, Dense nets, and Central nets are used to demonstrate the superiority of the suggested version. The experimental results show that in terms of accuracy, precision, recall, and F1-rating, the introduced version shown better performances than the other state-of-art hybrid learning models.

Edge-Enabled Modulation Classification in Internet of Underwater Things Based on Network Pruning and Ensemble Learning

Edge-Enabled Modulation Classification in Internet of Underwater Things Based on Network Pruning and Ensemble Learning

Investigating the rheological characteristics of alkali-activated concrete using contemporary artificial intelligence approaches

Abstract Using artificial intelligence-based tools, this research aims to establish a direct correlation between the alkali-activated concrete (AAC) mix design factors and their performances. More specifically, the machine learning system was fed new property data obtained from AAC mixes used in laboratory experiments. The rheological parameters (yield stress [static/dynamic] and plastic viscosity) of AAC were predicted using the multilayer perceptron neural network (MLPNN) and bagging ensemble (BE) models. In addition, the R 2 values, k-fold analyses, statistical checks, and the dissimilarity between the experimental and predicted compressive strength were employed to assess the performance of the created models. Also, the SHapley additive exPlanation (SHAP) approach was used for examining the relevance of influencing parameters. The BE approach was found to be significantly accurate in all prediction models, with R 2 greater than 0.90, and MLPNN models were found to be moderately precise, with R 2 slightly below 0.90. However, the error assessment through statistical checks and k-fold analysis also validated the higher precision of BE models over the MLPNN models. Building models that can calculate rheological properties of AAC for different values of input parameters could save a lot of time and money compared to doing the tests in a laboratory. In order to ascertain the required amounts of raw materials of AAC, investigators, as well as businesses, may find the SHAP study helpful.

Machine learning for monitoring hobbing tool health in CNC hobbing machine

Utilizing Machine Learning (ML) to oversee the status of hobbing cutters aims to enhance the gear manufacturing process’s effectiveness, output, and quality. Manufacturers can proactively enact measures to optimize tool performance and minimize downtime by conducting precise real-time assessments of hobbing cutter conditions. This proactive approach contributes to heightened product quality and decreased production costs. This study introduces an innovative condition monitoring system utilizing a Machine Learning approach. A Failure Mode and Effect Analysis (FMEA) were executed to gauge the severity of failures in hobbing cutters of Computer Numerical Control (CNC) Hobbing Machine, and the Risk Probability Number (RPN) was computed. This numerical value aids in prioritizing preventive measures by concentrating on failures with the most substantial potential impact. Failures with high RPN numbers were considered to implement the Machine Learning approach and artificial faults were induced in the hobbing cutter. Vibration signals (displacement, velocity, and acceleration) were then measured using a commercial high-capacity and high-frequency range Data Acquisition System (DAQ). The analysis covered operating parameters such as speed (ranging from 35 to 45 rpm), feed (ranging from 0.6 to 1 mm/rev), and depth of cut (6.8 mm). MATLAB code and script were employed to extract statistical features. These features were subsequently utilized to train seven algorithms (Decision Tree, Naive Bayes, Support Vector Machine (SVM), Efficient Linear, Kernel, Ensemble and Neural Network) as well as the application of Bayesian optimization for hyperparameter tuning and model evaluation were done. Amongst these algorithms, J48 Decision tree (DT) algorithm demonstrated impeccable accuracy, correctly classifying 100% of instances in the provided dataset. These algorithms stand out for their accuracy and efficiency in building, making them well-suited for this purpose. Based on ML model performance, it is recommended to employ J48 Decision Tree Model for the condition monitoring of a CNC hobbing cutter. The emerging confusion matrix was crucial in creating a condition monitoring system. This system can analyze statistical features extracted from vibration signals to assess the health of the cutter and classify it accordingly. The system alerts the operator when a hobbing cutter approaches a worn or damaged condition, enabling timely replacement before any issues arise.

Machine learning predictions for carbon monoxide levels in urban environments

The increasing carbon emissions in Malaysia necessitate accurate methods to track and control pollution levels. This study focuses on predicting carbon monoxide (CO) concentrations in Petaling Jaya using various machine learning models, and two important parameters, CO concentration and time, were considered in the analysis. Six distinct machine learning models were assessed to gauge their predictive capabilities. These models encompassed a range of regression modeling techniques namely; Linear, Tree, Gaussian Process, Ensemble of Trees, Support Vector, and Artificial Neural Networks (ANN) modelling. The Matern 5/2 Gaussian Process Regression (GPR) model consistently outperformed other models across all scenarios, demonstrating high R2 values and low RMSE, MSE, and MAE values. Specifically, in scenarios 1, 2, 3, and 4, the Matern 5/2 model exhibited the lowest RMSE (0.084–0.088) and highest R2 (0.97), highlighting its reliability and robustness in predicting CO concentrations. Additionally, the Rational Quadratic model achieved an R2 of 0.97 with an RMSE of 0.088 in scenario 1, while the Quadratic SVM excelled in scenario 3 with an R2 of 0.965 and low RMSE, MSE, and MAE values (0.085, 0.007, and 0.066). These findings provide valuable insights for environmental protection, renewable energy transition, energy efficiency, sustainable land use planning, and public awareness. However, acknowledging the study's single-area focus and potential limitations in representing diverse regions, further research is warranted to explore carbon emissions across varied areas and enhance the generalizability of the findings.

Deep transfer learning with fuzzy ensemble approach for the early detection of breast cancer

Breast Cancer is a significant global health challenge, particularly affecting women with higher mortality compared with other cancer types. Timely detection of such cancer types is crucial, and recent research, employing deep learning techniques, shows promise in earlier detection. The research focuses on the early detection of such tumors using mammogram images with deep-learning models. The paper utilized four public databases where a similar amount of 986 mammograms each for three classes (normal, benign, malignant) are taken for evaluation. Herein, three deep CNN models such as VGG-11, Inception v3, and ResNet50 are employed as base classifiers. The research adopts an ensemble method where the proposed approach makes use of the modified Gompertz function for building a fuzzy ranking of the base classification models and their decision scores are integrated in an adaptive manner for constructing the final prediction of results. The classification results of the proposed fuzzy ensemble approach outperform transfer learning models and other ensemble approaches such as weighted average and Sugeno integral techniques. The proposed ResNet50 ensemble network using the modified Gompertz function-based fuzzy ranking approach provides a superior classification accuracy of 98.986%.

Developing statistical and machine learning models for predicting CO2 solubility in live crude oils

CO2 solubility in crude oil primarily affects the viscosity and swelling capacity of oil and determines the displacement efficiency of CO2 flooding during the enhanced oil recovery process. Dissolution of CO2 into crude oil also ensures safe and permanent storage of CO2 in depleted formations via solubility trapping. This study employed statistical and machine learning algorithms to develop precise and stable predictive models for estimating CO2 solubility in crude oils with dissolved gas. Recognizing the limitations of existing experimental data on CO2 solubility for live oils (crude oils with dissolved gas), we introduced a novel approach employing statistical and machine learning techniques for developing accurate and robust predictive models. Our methodology combined regularization, k-fold cross-validation, and statistical significance tests to ensure the robustness of the models, practices not considered in the previous studies. A linear regression model with L2 regularization is developed as the base model and compared with a 2nd order polynomial model and an ensemble feed-forward neural network (FNN) model integrated with gradient boosting (GB). The incorporation of GB into the neural network capitalizes on the additive sequence of FNN models, thereby enhancing the accuracy and reliability of predictions. Moreover, an improved user-accessible and easily implementable correlation is proposed to estimate CO2 solubility in live crude oils at diverse operating conditions as a function of reservoir temperature, saturation pressure, bubble-point pressure, oil molecular weight, and specific gravity. The performances of the developed model and the correlation are compared against the literature models and correlations. The FNN model with an overall R2 score of 0.9978, average absolute relative deviation (AARD) of 1.54 %, and root mean squared error (RMSE) of 0.0083 outperformed the previously published models and correlations. The new correlation, while being relatively simpler than previously published correlations, showed similar predictive performance with an overall R2 score of 0.9817, AARD of 4.98 %, and RMSE of 0.0225. The model and the correlation can be used to estimate CO2 solubility in live crude oils with 0.67 to 0.97 specific gravity for reservoir temperatures and pressures in the range of 28 to 124 °C and 3.23 to 32.76 MPa, respectively.

An ensemble transfer learning-based deep convolution neural network for the detection and classification of diseased cotton leaves and plants

An ensemble transfer learning-based deep convolution neural network for the detection and classification of diseased cotton leaves and plants

Grading the severity of diabetic retinopathy using an ensemble of self-supervised pre-trained convolutional neural networks: ESSP-CNNs

Grading the severity of diabetic retinopathy using an ensemble of self-supervised pre-trained convolutional neural networks: ESSP-CNNs

Emotion Modeling in Speech Signals: Discrete Wavelet Transform and Machine Learning Tools for Emotion Recognition System

Speech emotion recognition (SER) is a challenging task due to the complex and subtle nature of emotions. This study proposes a novel approach for emotion modeling using speech signals by combining discrete wavelet transform (DWT) with linear prediction coding (LPC). The performance of various classifiers, including support vector machine (SVM), K-Nearest Neighbors (KNN), Efficient Logistic Regression, Naive Bayes, Ensemble, and Neural Network, was evaluated for emotion classification using the EMO-DB dataset. Evaluation metrics such as area under the curve (AUC), average prediction accuracy, and cross-validation techniques were employed. The results indicate that KNN and SVM classifiers exhibited high accuracy in distinguishing sadness from other emotions. Ensemble methods and Neural Networks also demonstrated strong performance in sadness classification. While Efficient Logistic Regression and Naive Bayes classifiers showed competitive performance, they were slightly less accurate compared to other classifiers. Furthermore, the proposed feature extraction method yielded the highest average accuracy, and its combination with formants or wavelet entropy further improved classification accuracy. On the other hand, Efficient Logistic Regression exhibited the lowest accuracies among the classifiers. The uniqueness of this study was that it investigated a combined feature extraction method and integrated them to compare with various forms of combinations. However, the purposes of the investigation include improved performance of the classifiers, high effectiveness of the system, and the potential for emotion classification tasks. These findings can guide the selection of appropriate classifiers and feature extraction methods in future research and real-world applications. Further investigations can focus on refining classifiers and exploring additional feature extraction techniques to enhance emotion classification accuracy.